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Abstract 

Every continuous function of two or more real variables can be written 
as the superposition of continuous functions of one real variable along with 
addition. 

1 Introduction 

The 13th Problem from Hilbert's famous Hst [3] asks whether every continuous 
function of three variables can be written as a superposition (in other words, 
composition) of continuous functions of two variables. Hilbert anticipated a 
negative answer saying, 

"it is probable that the root of the equation of the seventh degree 
is a function of its coefficients which [...] cannot be constructed by a 
finite number of insertions of functions of two arguments. In order 
to prove this, the proof would be necessary that the equation of the 
seventh degree + xf^ + yp + z/ + 1 = is not solvable with the 
help of any continuous functions of only two arguments." 

It took over 50 years for significant progress to be made on Hilbert's 13th Prob- 
lem. Then in 1954 Vitushkin [6] found a result in the direction Hilbert expected: 
\{ n/q > n' /q' then there are functions of n variables with all qth order deriva- 
tives continuous which can not be written as a superposition of functions of 
n' variables and all q'th order derivatives continuous. In particular, there are 
continuously differentiable functions of three variables which can not be written 
as a superposition of continuously differentiable functions of two variables. 

However Kolmogorov and Arnold subsequently proved a series of results 
culminating with Kolmogorov's 1957 Superposition Theorem. 
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Theorem 1 (Kolmogorov Superposition, [4]) For a fixed n > 2, there are 
n{2n+l) maps ip^'' £ C{[0, 1]) such that every map f G C([0, 1]") can be written: 

2n+l n 

13=1 p=i 
and i/ie G C(K.) are maps depending on f. 

This remarkable theorem gives a very strong positive solution to Hilbert's 13th 
Problem, indeed it says that every continuous function of two or more variables 
can be written as a superposition of continuous functions of just one variable 
along with just one function of two variables, namely addition. 

However the Kolmogorov Superposition Theorem is not a complete solution 
to Hilbert's 13th Problem. Hilbert's statement of the problem explicitly refers 
to functions (such as the root function of an equation of the seventh degree) 
of three real, or perhaps even more naturally, complex, variables. But the 
Kolmogorov Superposition Theorem only deals with functions on a compact 
cube — the variables are restricted to a closed and bounded interval. 

There have been numerous extensions to the Kolmogorov Superposition The- 
orem. Most notably Ostrand showed that compact, finite dimensional metriz- 
able spaces satisfy a superposition theorem, while Fridman [l] showed that the 
inner functions (the ip^'^) can be taken to be Lipschitz. However none solve 
Hilbert's 13th Problem for continuous functions of three real variables. 

In this paper we complete the solution of Hilbert's 13th Problem by showing 
that the Kolmogorov Superposition Theorem holds for all continuous functions 
/ : R™ — > R (Theorem [31) . Further, using earher work of the authors, [2j, we 
characterize the topological spaces satisfying a superposition result of the Kol- 
mogorov type. It turns out these spaces are precisely the locally compact, finite 
dimensional separable metrizable spaces, or equivalently, those spaces homeo- 
morphic to a closed subspace of Euclidean space (Theorem [4|. 



2 Superpositions 

Write C{X, Y) for all continuous maps from a space X to another space Y, and 
C{X) for C(X,R). Note that we always use the max norm. ||-}oo, on M™. 
Abstracting from Theorem [T] we make the following definition: 

Definition 2 Let X be a topological space. A family $ C C{X) is said to be 
basic for X if each f G C{X) can be written: f = J2q=i idq ° 4'q)> 

for some 0i, • • • , (/in in ^ and 'co-ordinate functions' gi, . . . , g„ G C(R). 

Note that the Kolmogorove Superposition Theorem says that every cube [0, 1]™ 
has a finite basic family in which each element of the basic family is a sum of 
functions of one variable. 
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Theorem 3 Fix m in N. There exist iIjP'^ G CiM), for q = 1,2, ... ,2m + I 
and p = 1,2, ... ,m, such that for any function f G C(IR'"), there can be found 
functions gi, ■ ■ ■ ,g2m+i in C(IR) such that: 

2m+l 

/(x)= 5^ 5,(<^9(x)), where (l>'^{xi,...,Xm) = ^^''{xi) + --- + i;^\xm). 

9=1 

Proof. We break the proof into four parts. In the first step we define a family 
of 'grids', and approximations to the functions V'^'^. Next wc define the V"^* and 
(j)'^, and estabhsh certain useful properties of the grids and functions. In the final 
two steps we show that the functions (b'^ are basic for R™, first for compactly 
supported functions, and then in general. 

1. Construction of the Grids and Approximations Wc establish by in- 
duction on k, the existence for each A; G N, p = 1, 2, . . . , m, and q = 1,2,..., 2m+ 
1, of positive Cfc, 7fc < 1/10, distinct positive prime numbers P^' > m + 10, 
discrete families ('grids') Sf. of open intervals of M and continuous functions 
/P"^ : M ^ R such that: 

(1) the sequences of efc's and 7fe's both strictly decrease to zero (in fact, for 

all A:, < tk+i < efe/6 and < 7fe < 1/fc), 

(2) each member of Si has diameter < 7^, 

for each fixed k any two of the families {S^. : q = 1, . . . , 2m +1} cover 
[— fc,A;], and all cover {—k,0,k}; 

(3) mck < 1/ nr=i for each g = 1, 2, . . . , 2m + 1; 

(4) /I'' is non-decreasing on M+ , non-increasing on R~ and constant outside 
[-k,k]; 

(5) /^"^ is constant on each member of 5^ with value a positive integral multi- 
pic of l/Pf, and (/r(./i)-/r(^2))Pr Pf / given Ji, J2 G 5f ; 
additionally, if J is an interval containing 0, then /I"' maps J to 0; 

(6) |/r(fc) -k\< l/(m + 1) and - fc| < l/(m + 1); 

(7) for each i < j < k and x € [-£,£], f^\x) < fl\x) < /f (x) + e,- - efc. 

Base Step: It is straightforward to find discrete collections of open intervals 
<Sf for p = 1, . . . , m and q = \, . . . , 2m+l such that any two of the famihes 
{<Sf^ : q = 1,2,- •• ,2m + 1} cover [—1,1], each of the families covers 
{1,0,-1}, and each interval in the collection has length < 71 = 1/10. 

Let m be the number of all the open interval in ah the collections 
{^<P<m, l<q< 2m + 1). For p = 1, . . . , m and q = 1, . . . , 2m + 1 
pick distinct primes Pf* larger than n\. 
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Now we define ff on [-1, 1]. Then for a; > 1 define ff\x) = /^(l), and 
for a; < -1 define ff^ix) = 

If J G Sf^, then define /f^ such that /f restricted to J is a positive 
integral multiple of l/Pf^. More specificallv, if G J then ff^iJ) = 0; if 
1 e J then /r(J) = 1 - l/Pf"; and if 1 G J then ff\J) = 1 - 2/^^. 
This can easily be done so that ff^ (as defined so far) is non-decreasing 
on [0, 1] and non-increasing on [—1,0]. 

For X in [—1, 1] \ U'^i*) interpolate Hnearly. 

Choose ei > such that mei < 1 / n™=i Pf^ for each g = 1, 2, • • • , 2m + 1. 
All (applicable) conditions (l)-(7) hold. 

Inductive Step: Suppose Pf.'Li, f-k-i, Ik-i, ^k-i ^^'^ /fe-i given and 

satisfy the requirements (l)-(7). 

By uniform continuity of ,fj!li on [—{k — l),/c — 1], there exists < 
min{l/fc,7fe_i} such that If^liixi) ~ fj^li{x2)\ < efc_i/6 if \xi-X2\ < 7fc 
for each p = 1, . . . , m and q = 1. . . . , 2m + 1. 

Then it is straightforward to find discrete collections of open intervals, 
S^'' for 1 < p < m and 1 < g < 2m + 1, such that any two of the families 
{S^"^ : q = 1,2,- •• ,2to + 1} cover [—k,k], each of the famihes covers 
{k, 0, —k}, each interval in the collection has length < 'y^ and the distance 
between each pair of adjacent intervals is also < 7fe. 

Let rifc be the total number of open intervals in all the collections <S^^ 
for p = 1, 2, . . . , m and q = 1,2,..., 2m + 1. For each p, q select distinct 
primes Pj^'^ so that 2nfc/P^^ < efc-i/6. 

Next, we give the construction of on [—k, k]. Outside of [— fc, k] extend 
constantly (as in the Base Step). 

• If J S <S^*, then f^'^iJ) is a positive integral multiple of 1/P^'^. For 
any J G 5^' with J n [—{k — l),fc — 1] ^ 0, we can ensure that 

/ri(^)</r(^)</ri(^)+^fc-i/3. 

[i] Since 2nfc/Pf < ek-i/6 and \fll^{xi) - .fll^{x2)\ < ek-i/6 
when \xi — X2] < 7fe, there are 2nk possible choices for the value of 
/r(J) (J G SD which makes r,l,{x) < fl\x) < f^.^^) + e^-i/S 
for X S Jn[— (fc— 1), k—1]. As there are many fewer than 2nk elements 
in 5f , wc can select the /r(J)'s such that (/f (Ji) - fr{J2))Pr 
mod PfcP" ^ for any Ji, J2 G 5f . 

[ii] More specifically, if G J then /^"^(J) = 0, if A: G J then 
/r(J) = 1 - l/Pr, and if -fc G J then /^(J) = 1 - 2/Pf . This 
can easily be done to make /|"^ (as defined so far) non-decreasing on 
[0, fc] and non-increasing on [— fc,0]. 

• If a; ^ U'^f'^', let Jl and Jr be the adjacent intervals in 5^' such 
that X Hes between them. Let a:;L be the right endpoint of Jl and 
xr be the left end point of Jr Then maps [xl,xr\ Hnearly to 
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[.fr-iiJL),.fr-iiJB)]- Since \xL-xn\<lk, \fr-ii^L) - fl\{xR)\ < 
e/c_i/6, therefore, /^'(cc) - fj!li{x) < ek-i/i + efc-i/6 = efc_i/2. 

Choose Cfe such that mck < min{l/ f^^^ P^*', efc_i/6} for all 1 < g < 
2m + 1. 

All requirements (l)-(7) are satisfied. 

2. Definition and Useful Properties of the Functions, ipP"^ and For 
X G K, let tpP'^lx) = limk^oo.fk'^{x). Now for a fixed n € N, and any x € [— n, n], 
fk''i^) — ijy^''ix) < ,fk''{x) + efe for fc > n + 1. So i/'^^ restricted to n,n], being 
the uniform limit of the for A; > n + 1, is continuous on [— n, n]. Therefore, 
■0^^ is continuous on M. 

Also, by construction, the image of [n. n + 1] under ip^'^ is a subset of [\n\ — 
l/(m + 1), |n| + 1 + l/(m+ 1)] for each n G Z. 

Let <j)'i{xu . ■ ■ ,Xm) = i^^'^ixi) + ■ ■ ■ + i^""i{xm) for (X1,X2,...,X„) GM'". 

Our eventual goal is to show {(f)'' : q = 1,2, . . . , 2m + 1} is a basic family of 
R"*, however first, we establish some useful properties of the grids and functions. 

For each q and k, let = {Ci x C2 x • • • x Cm : Cp G for each p = 
1,2,..., m}. Then we can say the following about JT"^. 

• For a fized q and k, is a discrete collection. 

• For a fixed k, any clement in belongs to at least m + 1 rectangles of 
J^, i.e. any m + 1 of {JT"^ : g = 1, . . . , 2m + 1} form an open cover of K™. 

Let Ul = {0«(C) : C G J'^'}. Take C = Ci x C2 x • • • x G J^, then 
(/)'?(C) is contained in the interval fl'^{Cp),YJ^=i fViCp) + mek]- By 

condition (3) in the construction of the /^', these closed intervals are disjoint 
for each q and k. Therefore, 

Claim ZYj^ is a discrete collection of subsets of M for each q and k. 

3. The (j)'^ are Basic for Compactly Supported Functions We now 

prove: 

Claim For any compactly supported h G C{W^), there are ffi, • ■ • , ff2m+i in 
C(IR) such that h = Y^^t^ 9q°4>q- 

Fix a compactly supported h G C(R™). Choose £ in N so that /i(x) = for 
any x outside K =[-1-1,1+ 1]". 

For each integer r > and q = l, - ■ ■ , 2m + 1, find positive kr and continuous 
functions : R — > M (fco = and Xi = for ^ach q) such that if /i''(x) = 
E'ri+' E:=oXI('A''(x)) and = sup^eM-IC^i - /^DWh then: 

(1) kr+\ > kr; 

(2) if ||a-b||oo < m/10'='-+i, then \{h - hr){a) - {h - hr){h)\ < (2m + 2)-iM^ 
for a,b G R"*; 
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(3) Xr+i constant on each member of l^^r+i ' 

(4) if C n (M™ \ Jf) ^ for C e Jl^^ , then the value of Xr+i is 0> 

otherwise, its value on (t>q{C) is (m + — hr){y) for some arbitrarily 

chosen element y G C; and 

(5) Xr+i(a;) < (m + l)-'^Mr for each a; e M. 

The kr and are defined inductively on r. Also for any a, b e C G Jkr+i ' 
||a- b||oo < m/10'='-+i. Therefore: 

(6) forxGU{^?:CG J.^'^^J, 

|(m + - M W - Xr+i(<^g W)| < (m + l)-i(2m + 2)-^Mr. 

Also for each x G M™, there arc at least m + 1 distinct values of q such that 
X G U{C : C' G J^^ ^}. Then there are m + 1 values of g such that (6) is true; 
for the other m values of q, (5) in the construction holds. 

Hence, for x G -fC, 

2m+l 

|(/l-/l,+l)(x)| = \{h-hr){^)-Y.xl+M^))\ 

9=1 

< (m + 1) ■ (m + l)"^(2m + 2)-^Mr + m • (m + l)-^Mr 

2m + 1 ,^ 
= Mr- 

2m + 2 

While for X ^ if, xt+iiM^)) = « by property (4). 

Therefore, M^+i < (2m + 1) • (2m + 2)-i • M^, so Mr < ((2m + 1) • (2m + 
2)"^)'' • Mo for each r, hence lim^^cx) Mr = 0, and thus /i(x) = hmr.^oo/ir(x) 
for all X G R". 

Moreover, by condition (5), the functions Y^I^qXI converge uniformly for 
each g to a continuous function gq ■.M.^R and 

2to+1 r 2m+l 

/i(x) = limr^oo/ir(x) = lim ^ Xl^^^'^^W) = S 9q{M^))- 

qr=l s=0 g=l 

This complete the proof of the Claim. 

4. The are Basic for All Functions We complete the proof by showing: 
Claim For any / G C(M'"), there are Qi, ■ ■ ■ ,g2m+i in C{R) such that / = 

E^=i+^9°<^9- 

First some preliminary definitions. Let K!^ be 

{{xi,X2, • •■ , Xm) ■ Xi G [— n - 2, — n] U [n, n + 2], xj G [— n — 2, n + 2] for j ^ i}. 
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and let /C = {if„ = IJ™ i K:nenu {0}}. 

For each n, the image of Kn under 0* is {[rt — 1, m{n + 2) + 1] : n G N U {0}} 
which is a locally finite collection of subsets of R. 

Next we inductively define a sequence of continuous functions on R™ for 
n e N U {0}, as follows: 

Base step: ao(x) = 1 for x G [-1, 1]™, ao(x) = for x G R" \ K^. 
Inductive step: q;„(x) = 1 — a„_i(x) for x G Kn H -ftr„-i, Q;„(x) = for 

X G R'" \ Kn. 

To prove the Claim, take any / G C(R™). Then /(x) = E.^o"*(x) ' /W- 
Also ai(x)-/(x) = Oifx^is:i. 

From the Claim in the previous Step, for each i G N U {0}, there exist 
continuous functions g\, . . . , q^m+i such that ai(x) • /(x) ~ J^l^i^ 9q{4>'^{^))- 

Then let gq = J2iZo 9q- This function is well-defined and continuous because 
{x '■ gq{x) 0} C — m{i + 2) + 1], which means there are only finitely many 
i with gq{x) ^ for each a; G R. 

Then we have 



Theorem 4 Let X be a Tychonoff space. Then the following are equivalent: 

(1) some power of X has a finite basic family; 

(2) for every m,n N, there is an r G N and i/;^' from C(X, R"), for q = 
1, . . . , r and p — 1, . . . ,m, such that every f G C{X™, R") can be written 



for some gi,...,gr in C(R",R"); 

(3) X is a locally compact, finite dimensional separable metric space, or equiv- 
alently, homeomorphic to a closed subspace of Euclidean space. 

Proof. It was shown in \2l that a Tychonoff space has a finite basic family if 
and only if it is a locally compact, finite dimensional separable metrizable space. 
Hence (1) impHes (3), and (2) impHes (1). 

Now suppose (3) holds and X is a locally compact, finite dimensional sep- 
arable metric space. Fix m. Then X is (homeomorphic to) a closed subspace 
of some R^. We establish (2) when n — 1. The general case follows easily by 
working co-ordinate wise. 




/(x) = ^a.(x) . /(x) alin^)) = E 5,(0^ W), 




as claimed. 
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According to Theorem [3] there exist '0^' for p — 1,2, . . . ,£m and q = 
1,2,..., 2£m + 1 such that any / S C(R^'") can be written as f{xi, . . . , x^m) = 
EfT' 9,iElZ r'^i^v)) for some g, e C(R). 

Let r = 2£m + 1. Let = ^^^(p-iTm V'''' for p = 1, . . . , m and g = 
1, . . . , r. Since X is a closed subset of R^, any continuous function on X can be 
continuously extended to M^. Then {vJ/p? \ X : p ~ 1, . . . ,m, and g = 1, . . . , r} 
are as required. ■ 

Note that from Theorem |4lj2) it follows that every continuous function of 
three complex variables can be written as a superposition of addition and con- 
tinuous functions of one complex varaiable. 
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